DOCUMENT RESUME 



ED 377 037 



SE 055 140 



TITLE 

INSTITUTION 

SPONS AGENCY 

REPORT NO 
PUB DATE 
CONTRACT 
NOTE 

AVAILABLE FROM 



PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Reform of High School Mathematics and Science and 
Opportunity To Learn. CPRE Policy Briefs. 
Consortium for Policy Research in Education, New 
Brunswick, NJ . 

Office of Educational Research and Improvement (ED) , 

Washington, DC. 

CPRE-RB-13-9/94 

Sep 94 

R117G1007 

14p. 

CPRE Policy Briefs, Carriage House at the Eagleton 
institute of Politics, Rutgers University, 86 Clifton 
Avenue, New Brunswick, NJ 08901-1568 (single copy 
free) . 

Reports - Research/Technical (143) 
MF01/PC01 Plus Postage. 

*Educat i onal Change; Graduation Requirements; High 
Schools; *Mathemat i cs Curriculum; Mathematics 
Education; Questionnaires; *Science Curriculum; 
Science Education; ''Science Instruction; ^Secondary 
School Mathematics; Secondary School Science; State 
Standards; Teaching Methods 

Ma thema t ics Education Research; *NCTM Curriculum and 
Evaluation Standards; *Project 2061 (AAAS) ; Reform 
Efforts; Science Education Research 



ABSTRACT 

The purpose of this brief is to draw from the 
findings of the 1990 Reform Up Close study of high school mathematics 
an<J science in six states by the Consortium for Policy Research in 
Education in order to: (1) characterize standard-setting policies in 
high school mathematics and science, (2) document the effects of 
these standard-setting policies on the math and science curriculum as 
experienced by students, and (3) compare the nature of the enacted 
curriculum to the de sired curriculum as reflected in documents of 
today's curriculum reforms. It was found that the content of 
mathematics and science courses appeared not to have been compromised 
by increased enrollments, but the instruction still looked quite 
traditional. (MKR) 
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Reform of High School Mathematics and 
Science and Opportunity to Learn 

by Andrew C. Porter and Associates 



This policy brief concerns the nature of the high 
school mathematics and science curriculum in the 
United States. It draws from a large study which 
documented instructional practices and content (the 
enacted curriculum) using novel methodologies. 1 
This research approach is a promising step toward 
the development of indicators of opportunity to learn 
(see sidebar on page 9). The study also provides 
encouraging news about the effects of increased 
standards in math and science — they did not result 
in a watering down of the curriculum. However, 
practice in the schools studied is a far cry from the 
ambitious goals for math and science instruction 
now being developed by the profession. 



by National Ed icational Goal 4, "By the year 2000, 
U. S. students will be first in the world in science 
and mathematics achievement" (U. S. Department of 
Education 1990, 5). 

As states, universities, school districts, and schools 
took steps to increase the standards they set for 
students, others began to worry about the possible 
unintended consequences. What if higher standards 
for high school graduation, both in terms of course 
requirements and performance standards, !ed to 
increases in dropout rates? What if gains from the 
equity initiatives of the 1960s and 1970s were to fall 
victim to the standard setting activities of the 1980s? 
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Background 

The early 1980s were years of intense criticism of 
the productivity of the education system in the 
United States. These criticisms gave rise to a host of 
standard-setting activities, many of which began in 
the mid-1980s and continue to the time of this 
writing. Lagging achievement in science and mathe- 
matics was a special target for concern, as reflected 



! The research reported in this report was supported by the 
Consortium for Policy Research in Education through a grant 
from the National Science Foundation (Grant No. SPA- 
8953446) and by the Wisconsin Center for Education 
Research, School of Education, University of Wisconsin- 
Madison. The authors are solely responsible for the views 
expressed here. 



Those who expressed reservations about increasing 
education standards first hypothesized that, as a 
result of increased standards, high school graduation 
rates would decrease, dropout rates would increase, 
and these negative results would be especially true 
for minority and poor students. At least to date, that 
hypothesis has not come true (U. S. Department of 
Education 1992). 

When the feared retention problem did not material- 
ize, a second concern emerged. Was it possible that 
schools were accommodating students by allowing 
them to meet the new standards through remedial 
and basic courses? To address this possibility, Clune 
and White (1992) analyzed transcript data on 
changes in course-taking patterns among graduates 
of high schools enrolling mostly lower achieving 
students in four states that had increased their high 
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school graduation requirements. 
They found that credits com- 
pleted in academic subjects did 
increase by a substantial one-half 
year of instruction on average 
and that the additional academic 
credits completed were in courses 
of varying levels of difficulty, 
not just in remedial and basic 
level courses. 

For those who doubted the bene- 
fits of increased standard setting, 
however, there remained yet a 
third hypothesis. What if, after 
standards were increased, the 
actual instruction in courses was 
weakened? What if the increases 
in numbers of students taking 
algebra, for example, resulted in 
a watered down algebra curricu- 
lum to accommodate the weaker 
and less motivated students? It 
was exactly this third concern 
that served as the primary moti- 
vation for CPRE's 1990 Reform 
Up Close study of high school 
mathematics and science funded 
by the National Science Founda- 
tion (Porter et ah 1993). 

The purpose of this brief is to 
draw from the findings of that 
study to (1) characterize stan- 
dard-setting policies in high 
school mathematics and science, 
(2) document the effects of these 
standard-setting policies on the 
math and science curriculum as 
experienced by students, and (3) 
compare the nature of the ena- 
cted curriculum to the desired 
curriculum as reflected in docu- 
ments of today's curriculum re- 
forms. 



Design and Sample 

Six states were selected based on 
their ability to provide contrasts 
in curriculum policy formulation, 
although all six had significantly 
increased math and science high 
school graduation requirements 
in the 1980s. California and Ari- 
zona represented two states al- 



ready at work on trying to re- 
form curriculum to place greater 
emphasis on higher-order think- 
ing and problem-solving. They 
were pursuing these goals using 
a variety of strategies. In con- 
trast, Florida and South Carolina 
were two states with fairly com- 
prehensive curriculum control 
strategies aimed at guaranteeing 
basic skills. Missouii and Penn- 
sylvania stood between these ex- 
tremes in that they were relative- 
ly inactive in terms of providing 
any type of curriculum leader- 
ship. 

In each state, two districts were 
selected, one large urban and one 
smaller suburban/rural. This 
allowed investigation of curricu- 
lum policymaking in both large - 
and small-district bureaucracies. 
In the urban districts, two high 
schools were studied so that 
within-district school variability 
could be determined. In the 
smaller district, only one high 
school was studied; in some of 
the districts, only one high 
school existed. Throughout, the 
focus was on schools serving 
high concentrations of low- 
achieving students from poor 
families. 

For describing the enacted cur- 
riculum, teacher's daily logs of 
instruction were obtained from 
two math and two science course 
sections in each high school. 
Courses were selected because of 
large enrollment gains since state 
increases in high school gradua- 
tion requirements. The sample of 
log data represented 62 course 
sections with a median of 165 
instructional days. In addition, 
math and science teachers in the 
1 8 schools studied were surveyed 
via a written questionnaire. Class- 
room observations and teacher 
interviews completed the data 
collection strategies for de- 
scribing the enacted curriculum. 
Interviews were conducted at the 
school, district, and state levels 
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to characterize curriculum poli- 
cies and their perceived effects. 

The data set for analysis was 
large and complex, consisting of 
18 interviews of state education 
agency staff, 44 interviews of 
district administrators, 76 inter- 
views of school administrators, 
and 81 interviews of teachers. 
Also, 116 classroom observa- 
tions, 312 teacher questionnaires, 
and teacher logs on 62 course 
sections were analyzed. 

The logs provided data on the 
enacted curriculum that was in 
high agreement with independent 
reports from classroom observa- 
tions. Questionnaire data, in turn, 
was seen to correlate well with 
teacher log data, while requiring 
substantially less cost and re- 
spondent burden. The study 
showed it is possible to monitor 
the enacted curriculum on a 
fairly large scale (Smithson and 
Porter 1994). 



Standard Setting 
Policies in 1990 

Our Reform Up Close study of 
high school mathematics and 
science took place at a time cf 
great transition. The basic skills 
focus of curriculum policies in 
the 1970s were giving way to a 
focus on providing instruction in 
higher-order thinking and pro- 
blem-solving for all students. 
Professional associations had 
begun the curriculum standard- 
setting process, with the National 
Council of Teachers of Mathe- 
matics in the lead. Some states 
were ahead of the professional 
associations; in our sample Cali- 
fornia was the best example. But 
not all states were in the same 
place in the transition from basic 
skills to ambitious content for all 
students. In our sample, Missouri 
and Pennsylvania, relatively in- 
active states in the prior basic 



skills movement, had not yet 
picked up the mantle for the new 
reform either. South Carolina and 
Florida, two examples of states 
providing leadership in guaran- 
teeing basic skills for all stu- 
dents, found themselves caught 
in a bind. Just when they had in 
place well-functioning basic 
skills curriculum policies, the 
nation decided to move toward a 
new goal of ambitious content 
for all students. At the time of 
our study, these states were 
beginning to talk about changing 
their systems, but with their 
heavy reliance on basic skills 
mandates, much work needed to 
be undone. 

Because states, districts, and 
schools were in a transition per- 
iod, moving from one curriculum 
reform to another, 1990 was a 
time of great inconsistency among 
policies. Curriculum frameworks 
appeared to be the policy in- 
strument of choice for states and 
districts moving toward the goal 
of ambitious content for all stu- 
dents. California and Arizona 
both had curriculum frameworks 
consistent with this goal. 

We also detected a transition in 
the style of curriculum policy 
formulation. As the goal shifted 
from one of guaranteeing mini- 
mum basic skills to one of 
higher-order thinking and prob- 
lem-solving, the style of policy 
leadership appeared to be shift- 
ing from controls and mandates 
to persuasion. 

California's curriculum frame- 
work was not required, nor were 
there clear rewards and sanctions 
later attached to California's new 
assessment program. Increasing- 
ly, teachers were being involved 
in significant ways in policy for- 
mulation and development. 
Teachers always have had an 
important role in textbook adop- 
tion in California, and in some 
cases have been significantly 




involved in developing curricu- 
lum frameworks and guides. But 
in our states and districts in 
1990-91, there was significant 
teacher involvement in nearly 
every policy initiative at every 
level of the formal school hier- 
archy. This movement in cur- 
riculum leadership, away from 
control and toward persuasion, 
seemed to be a very positive de- 
velopment. Curriculum policies 
in which teachers have had sig- 
nificant involvement are likely to 
be authoritative and convincing. 
Their effects are likely to be both 
longer lasting and more consis- 
tent with the intended goals (e.g., 
Porter 1989). 

Not only was 1990 a period of 
transition in curriculum policy 
formulation, it was also a time 
during which states, districts, and 
schools differed sharply one 
from another in the nature and 
extent of their curriculum policy 
leadership. There were some pat- 
terns, however. Districts tended 
to find state curriculum leader- 
ship helpful, especially the large 
urban districts. In California, 
where state frameworks empha- 
sized ambitious content for all 
students, the urban district was 
trying to eliminate tracking in its 



schools. The same was true for 
Arizona and the large urban 
district there. In South Carolina, 
state basic skills and testing 
initiatives were strengthened sub- 
stantially by district tests de- 
signed for selected courses and 
which Students were required to 
pass to receive course credit. 
Florida's curriculum control basic 
skills initiatives were enhanced 
substantially by the Florida urban 
district's policy of giving mone- 
tary bonuses to schools and 
teachers exhibiting good test 
performance. In contrast, our 
rural districts, with their substan- 
tially smaller bureaucracies but 
not necessarily less pressing 
problems, tended to take a mini- 
malist approach to curriculum 
leadership. In some cases, these 
rural districts were so small that 
distinguishing between district 
and high school policies was 
impossible. 

Standard-Setting in 
the Sample 

Because curriculum policies pro- 
vide flexibility and room for 
interpretation, school-level re- 
sponse frequently determines the 
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degree of upgrading that actually 
occurs. In the Arizona urban 
district, one of the two high 
schools studied required all stu- 
dents to take a first-year algebra 
course and a first-year chemistry/ 
physics course. The curriculum 
of these courses was standar- 
dized through school-level cur- 
riculum guides and school-level 
staff development. Similarly, the 
high school in the smaller urban 
district in Pennsylvania had 
moved to eliminate all basic 
courses in math and science. It 
was requiring that nearly all 
freshmen take algebra. In the 
urban South Carolina district, 
one of the two high schools was 
following the district's lead to 
push increasing numbers of stu- 
dents into college preparatory 
courses. In contrast, teachers in 
the other school had convinced 
the principal that increasing 
enrollment in college preparatory 
courses was not a useful strategy 
and would not benefit students. 

Two of the most frequently men- 
tioned curriculum policy instru- 
ments deserve special mention. 
Textbooks and tests are impor- 
tant instructional resources that 
can and often do influence the 
nature of high school mathema- 
tics and science instruction. 

Textbook adoption does not ap- 
pear to have been a particularly 
forceful curriculum control poli- 
cy in high school mathematics 
and science. Of our six states, 
only South Carolina and Florida 
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had textbook adoption policies 
that applied to high schools. 
Both states left significant choice 
to the district, Some districts had 
adopted a single text for each 
high school mathematics and 
science course offered. Typically, 
these were the small rural dis- 
tricts where there is only one or 
possibly two high schools in the 
district. 

The real story to be told about 
instructional materials, however, 
is not about the ways in which 
they were being used by states 
and districts to control local 
practice. Rather, the most signi- 
ficant point is that instructional 
materials to support the cur- 
riculum reform of ambitious con- 
tent for all students were simply 
not available. Hopefully the pub- 
lishing industry will respond to 
the reforms by providing needed 
materials. If they do not, cur- 
ricular reform is almost sure to 
fail. No matter how often and by 
whom teachers are admonished 
to develop their own materials 
and not be textbook followers, 
most teachers feel that they have 
neither the time nor the expertise 
to offer instruction without a 
supporting text. 

Testing also plays a unique role 
as an instrument of curriculum 
policy control in high school 
math and science. First, most 
states and districts tested mathe- 
matics in high school, but sub- 
stantially fewer tested in science. 
Thus, mathematics was a much 
more regulated curriculum in 
high school than was science. 
This remains true today. Second, 
in the two states with high school 
graduation tests, South Carolina 
and Florida, the effect of the 
tests was to increase the number 
of remedial courses and the 
amount of remedial instruction 
received by students. Since, in 
both states, mathematics was a 
part of the high school gradua- 
tion test and science was not, 
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more remediation was seen in 
mathematics than in science. 
Whether or not this was a posi- 
tive development for stud .nts is 
unclear. On the one hand, many 
of the students receiving reme- 
dial instruction did eventually get 
to the point where they could 
pass the test and graduate. On 
the other hand, the material 
tested was material that students 
should have mastered by sixth 
grade. In some sense, then, stu- 
dents limited to remedial instruc- 
tion are not receiving a high 
school education in mathematics. 

The Influence of 
Standard-Setting 
Policies in 
Mathematics 
and Science on 
Student Opportunity 
to Learn 

The information collected through 
daily teacher logs and the infor- 
mation collected through teacher 
questionnaires allow a compre- 
hensive and detailed description 
of high school mathematics and 
science instruction in our six 
states, at least as taught in high 
schools serving high concentra- 
tions of low-achieving students. 
The questionnaire data represent 
all mathematics and science 
courses and all mathematics and 
science teachers in the high 
schools studied. In contrast, the 
log data are more selective, 
providing detailed descriptions of 
the enacted curriculum for 
courses experiencing the largest 
gains in enrollment following 
increases in math and science 
graduation requirements. 

By comparing the enacted curric- 
ulum as described by the ques- 
tionnaire data to the enacted 
curriculum as described by the 
enrollment-gaining courses in the 



log data, it is possible to see 
whether or not increases in 
enrollment compromised the cur- 
riculum in either math or sci- 
ence. If large influxes of new 
students, presumably less quali- 
fied, did bring about a "watering 
down" of the curriculum, then 
the courses described by log data 
would look weaker than courses 
with the same titles in the larger 
questionnaire sample. Two of the 
math' courses, both Algebra 1, 
were in schools that required all 
students to take Algebra 1. One 
of the science courses, Chemis- 
try/Physics, was in a high school 
that required it of all students. 
Comparing these required courses 
to other courses in the log sam- 
ple with the same titles but not 
required of all students provides 
a second check on the "watering 
down" hypothesis. 

For each type of math and sci- 
ence course, comparisons of the 
questionnaire sample to the log 
sample uncovered only minor 
differences in what was taught. 
Thus, the more heavily sub- 
scribed log sample courses showed 
few, if any, signs of being weak- 
er than the questionnaire courses 
taken by fewer students. For 
example, the content of Algebra 
1 looked much the same, regard- 
less of whether or not the Alge- 
bra 1 section was in a school 
where Algebra 1 had experienced 
large increases in enrollment. Bi- 
ology looked much like Biology 
regardless of the percentage of 
the student body taking the 
course. 

The three required courses in the 
log sample provide a somewhat 





stiffer test of the hypothesis that 
the curriculum upgrading strate- 
gy of increasing enrollments in 
advanced courses results in those 
courses being watered down. For 
the two Algebra 1 courses re- 
quired of all students, one em- 
phasized algebra (as opposed to 
other content areas such as arith- 
metic) even more than was true 
for the average of all Algebra 1 
courses in the log sample. The 
other required Algebra 1 course 
emphasized algebra or 1 " slightly 
less than the average for all 
Algebra 1 courses. 

When looking more closely at 
the types of algebra topics em- 
phasized, both required courses 
put greater emphasis on ad- 
vanced topics than was true for 
the average of all Algebra 1 
courses. The required Algebra 1 
course with the greatest emphasis 
on algebra topics also put an 
unusually high emphasis on 
nonlinear equations. The other 
required Algebra 1 course placed 
a higher emphasis on work in- 
volving systems of equations, a 
topic more likely to be taught in 
Algebra 2 courses than in Alge- 
bra 1 courses. Despite the fact 
that all students were required to 



take them, both of the two 
required courses looked much 
more like Algebra 1 courses than 
they looked like Pre-algebra 
ourses. Neither course looked 
anything like General Math. 

When extending the analysis of 
the two required Algebra 1 courses 
to consider modes of instruction 
and intended student outcomes, 
still there was no evidence that 
the enacted curriculum had been 
watered down. The two required 
courses parallelled algebra courses 
generally in the degree to which 
instruction consisted of lecture, 
use of concrete or pictorial mod- 
els, equations/formulas, graphs or 
lab work. Both required courses 
placed a lower emphasis on 
computation than did Algebra 1 
courses in general. 

The required course that placed 
the greatest emphasis on algebra 
made up for its relatively lower 
emphasis on computation by 
stressing student understanding 
and memorizing facts. The other 
required Algebra 1 course re- 
placed the typical emphasis on 
computation with a relatively 
greater emphasis on solving rou- 
tine problems (e.g., story piob- 
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lems). If anything, this finding 
represents a stronger curriculum 
for that required course than for 
Algebra 1 courses in general. 

Similarly, for the required Chem- 
istry/Physics course there was no 
evidence that increased enroll- 
ments had weakened the content 
of instruction. The required Chem- 
istry/Physics course looked al- 
most identical to a college prep 
Physical Science course in the 
sample, with both courses devot- 
ing 37 percent of instructional 
time to chemistry, 37 percent to 
physics, and 24 percent to topics 
on the nature of science. Within 
these content areas, the required 
Chemistry/Physics course placed 
a greater emphasis on atomic and 
nuclear structure and energy and 
less emphasis on chemical pro- 
perties and processes and organic 
chemistry than did the college 
prep Physical Science course. 
These differences are suggestive 
not of a watering down, but 
rather simply of a difference in 
substantive focus. 

The required Chemistry/Physics 
course relied less heavily on 
written and oral exposition than 
either the college prep Physical 
Science course or Physical Sci- 
ence courses in general. Instead, 
the required course placed a 
relatively greater emphasis on 
work involving pictorial and con- 
crete models (28 percent of in- 
structional time), suggesting that 
the required course provided a 
better quality of instruction than 
either Physical Science courses 
or the college prep Physical Sci- 
ence course. Similarly, the re- 
quired Chemistry/Physics course 



placed less emphasis on students 
memorizing facts and more em- 
phasis on students replicating 
experiments than did either the 
college prep Physical Science 
course or Physical Science courses 
in general. 

Thus, no evidence was found 
that requiring more students to 
take more advanced mathematics 
and science resulted in compro- 
mising the curricula of the courses 
experiencing the increased en- 
rollments. Algebra 1 remained 
Algebra 1, regardless of whether 
all students were required to take 
it. The required Chemistry/Phys- 
ics course looked as challenging 
in terms of topics covered as did 
the college prep Physical Science 
course, and the actual quality of 
instruction looked better. 

Professional 
Standards and the 
Enacted Curriculum 
in High School 
Mathematics and 
Science 

The questionnaire and log data 
provide a description of the en- 
acted curriculum in high school 
mathematics and science courses 
(in high schools serving high 
concentrations of low-achieving 
students) at a level of detail not 
previously available and in a 
language that facilitates com- 
parisons and contrasts across 
courses, schools, districts, and 
states. This rich and comprehen- 
sive description of high school 
mathematics and science class- 
room practices can be used to 
compared actual practice to that 
called for by the reports of 
professional societies, especially 
the NCTM Curriculum Standards 
( 1 989) and the AAAS Science for 
All Americans (1989). Because 
the initiation of those curriculum 
reforms roughly corresponded in 



time to the period of data 
collection, the descriptions 
cannot be taken as an evaluation 
of progress toward realizing 
those reforms. Rather the de- 
scriptions of classroom practice 
from Reform Up Close provide a 
baseline from which can be seen 
the types of changes necessary. 

What Topics Are Taught 

The math courses in the log 
sample provided few surprises, 
though some disappointments, 
about 'he content of instruction. 
Basic math courses consisted 
primarily of arithmetic and mea- 
surement, with a few of the basic 
courses also including significant 
emphasis on algebra. 

Algebra courses were dominated 
by algebra content. Eighty-three 
percent of instructional time was 
on algebra in Algebra I courses, 
and 88 percent of instructional 
time was on algebra for Algebra 
2 courses. Pre-algebra stood mid- 
way between basic math courses 
and Algebra 1 courses, with a 
dual emphasis on arithmetic (34 
percent of the time) and algebra 
(43 percent of the time). The 
algebra covered in Pre-algebra 
was extremely narrow in focus, 
limited to expressions and linear 
equations. Geometry courses em- 
phasized geometry content (78 
percent of instructional time). 

For mathematics, the big news 
was not so much the content 
covered in traditional courses but 
rather, in comparison to the 
NCTM Standards, the content 
not covered. None of the math 
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courses studied gave significant 
attention to statistics, probability, 
or discrete mathematics. Pre- 
calculus courses did give some 
attention to probability, but only 
the most elementary probability 
topics. For example, Pre-calculus 
courses did not include empirical 
probability, conditional probabil- 
ity, or any attention to discrete or 
continuous distributions. 

While Algebra I looked pretty 
much like Algebra 1 wherever it 
was found, Biology courses dif- 
fered dramatically one from 
another. Some Biology courses 
looked more like broad survey 
courses of all science than they 
looked like Biology courses. 
Other Biology courses covered 
all of the main content areas in 
biology (biology of the cell, 
human biology, biology of other 
organisms, and biology of popu- 
lations). Other Biology courses 
were survey courses of all biol- 
ogy content but with an addi- 
tional emphasis on chemistry. 
Still other Biology courses focus 
almost exclusively on the content 
of biology of other organisms. 
The data from our sample sug- 
gest that knowing a student has 
taken high school Biology says 
relatively little about what con- 
tent that student has studied. The 
same can be said for Life Sci- 
ence courses, which were essen- 
tially Biology courses them- 
selves. 



Although mathematics courses 
focussed on relatively fewer 
topics than science courses, the 
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depth of instruction did not differ 
much between mathematics and 
science. Depth of instruction was 
defined as the number of dif- 
ferent ways that a topic was 
taught (mode of instruction) in 
combination with the number of 
different intended student out- 
comes (e.g., understanding, 
memorization, computation). 
What was most striking was the 
general lack of depth of instruc- 
tion for the courses in the sam- 
ple. On average, a topic was 
taught in only 3 or 4 of the 
possible 63 combinations of 
modes of instruction and in- 
tended student outcomes defined 
for this study. This finding 
varied little from course type to 
course type and held for both 
mathematics and science. 

How Those Topics Are 
Taught 

Both mathematics and science 
courses were dominated by expo- 
sition, either verbal or written, as 
the primary mode of instruction. 
In mathematics, exposition was 
especially high in the lower-level 
courses, consuming two-thirds to 
three-fourths of instructional 
time. In science, reliance on 
exposition as the mode of in- 
struction was less predictable, at 
least by course level. In both 
subjects and for virtually all of 
the course types studied, students 
spent the majority of their time 
either being talked to by the 
teacheror working independently 
at their desks. On average and 
for both math and science, one- 
third of the time was spent in 
seatwork, while only 25 percent 
of the time was spent in class 
discussion and small-group work. 

There was very little lab work in 
either mathematics or science. 
What little lab work was done in 
mathematics consisted almost 
entirely of drill and practice at a 
computer terminal. In science, 
half of the courses in the log 
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sample spent 5 percent or less of 
instructional time in lab work. 
The relative emphasis on lab 
work was specific to a particular 
course section and did not vary 
by course type. For example, the 
relative emphasis on lab work 
was no greater for chemistry 
courses than for physical science 
courses. 

In neither mathematics nor sci- 
ence was there any field work to 
speal' of. Nor did either subject 
involve students much in graph 
work, with only 1 percent of in- 
structional time spent on graph 
work in science and a surprising- 
ly low 4 percent of instructional 
tine for graph work in mathe- 
matics. 

One bright spot in an otherwise 
disappointing profile of instruc- 
tion was the use of pictorial 
models in science. On average, 
15 percent of science instruc- 
tional time involved pictorial 
models; there was relatively little 
variance in the use of pictorial 
models across different science 
course types. 

What emerges, then, from the 
information on modes of instruc- 
tion is a great deal of teacher 
lecture and student independent 
seatwork, with very little empha- 
sis on active engagement of 
students in the construction of 
their own knowledge. The gap 
between actual practice and the 
espoused curriculum reforms of 
the late 1980s was especially 
large. 

Summary and 
Conclusions 

The data from Reform Up Close 
provide a largely positive picture 
of the effects of state, district, 
and school standard-setting acti- 
vities. As a result of higher stan- 
dards, more high school students 



were receiving more worthwhile 
math and science instruction in 
1990 than ever before. 

The best news is that the content 
of mathematics and science 
courses appeared not to have 
been compromised by increased 
enrollments. One might have 
hoped, however, that the peda- 
gogical strategies employed by 
icachers would have expanded to 
accommodate the instructional 
needs of the greater diversity of 
students. Unfortunately, this was 
not the case. Throughout the 
sample of mathematics and 
science courses, instruction 
looked quite traditional. Empha- 
sis was on teacher lecture and 
student independent seatwork. 

In 1990-91, the enacted curricu- 
lum in high school mathematics 
and science was not at all in 
alignment with the curriculum 
reform toward higher-order 
thinking and problem-solving for 
all students. In mathematics, 
there were far too many remedial 
and basic courses with essential- 
ly arithmetic as content. Statis- 
tics, probability, and discrete 
mathematics, content areas 
emphasized in the new curricu- 
lum standards, received virtually 
no attention in any of the courses 
studied, including advanced 
courses. All math courses 
reflected a heavy emphasis on 
exposition and equations, with 
little emphasis upon modelling, 
real-world problems, and data 
application. The emphasis re- 
mained heavily on memorization 
and computation. 

In science, the picture was simi- 
lar. Science courses made little 
to no use of field work. Nearly 
half of the science courses 
allocated less than 5 percent of 
instructional time for lab work, 
and approximately half of the 
courses studied allocated less 
than 10 percent of instructional 
time to collecting data. Instead, 



the emphasis was heavily on 
memorizing facts and under- 
standing concepts through lecture 
and textbook presentation. Clear- 
ly, the current curriculum re- 
forms have their work cut out for 
them. 

As for curriculum policymaking, 
none of the six states and eigh- 
teen districts had anything like a 
comprehensive approach to sup- 
porting the ambitious math and 
science curriculum reforms of 
1989. Teacher empowerment re- 
forms appeared to coexist with 
curriculum control measures in a 
sort of uneasy peace. Neither 
type of initiative appeared to 
give much recognition to the 
other. Rather, they coexisted in 
ways that left unresolved ten- 
sions that each created for the 
other. 

Regardless of whether curricu- 
lum control or teacher empower- 
ment ultimately becomes the pre- 
ferred reform mechanism, staff 
development would appear to 
play a crucial role. However, we 
saw little by way of staff deve- 
lopment that appeared up to the 
challenges ahead. Most staff 
development we found was frag- 
mented and piecemeal, identified 
and delivered by persons distant 
from the classroom, and with 
little, if any, explicit connection 
to strengthening academic 
instruction. 
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Examining Opportunity to Learn Standards 



In its 1992 report, Raising Standards for American 
Education the National Council on Education 
Standards and Testing called for the development of 
"school delivery standards" to help assess a school's 
capacity and performance. In response to this report, 
the National Governors' Association began looking 
at how states might address the issue of SDS. 

During the course of NH.Vs work and the develop- 
ment of the Clinton Administration's Goals 2000 
Act, the terminology shifted from school delivery 
standards to "opportunity to learn" standards (OTL). 

Opportunity to learn describes the "enacted 
curriculum as experienced by the student," says 
Andrew Porter in his paper, Defining and Measuri 
ng Opportunity to Learn. In the past, he says, 
greatest emphasis has been placed on the content of 
instruction, the particular concepts, skills and 
applications that are to be taught. But OTL has also 
included the pedagogical quality of instruction and 
the resources that arc available to students and 
teachers as instruction takes place. 

School delivery/opportunity to learn standards were 
instituted to prevent students from receiving a poor 
education, says Porter. There are at least three ways 
this might be done, he explains. 

1. Standards might present a vision of good practice, 
presenting detailed accounts of effective instruc- 
tional practices and school strategies in support of 
the goal of challenging content for all students. 

2. The standards might provide a framework for a 
school-process indicator system that would describe 
in what ways and to what extent instruction in 
schools are consistent with the vision. 

3. The standards might be the basis for school-by- 
school accountability. However, this is the least 
attractive use of OTL standards. Using th*,m for 
school accountability is likely to shift attention away 
from outcomes and back to processes, something 
that has already failed to have the desired effects. 

For more information on OTL, please see these 
publications by CPRE researchers: 

In The Debate on Opportunity to Learn Standards: 
Supporting Works (Washington, DC: National 
Governor's Association): 



Elmore, R. F., and S. F. Fuhrman. 1993. "Opportun- 
ity to Learn and the State Role in Education." 

Porter, A. C. 1993. "Defining and Measuring Oppor- 
tunity to Learn/' 

Porter, A. C. 1993. "School Delivery Standards." 
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Including School Finance in Systemic Reform 
Strategies: A Commentary*, May 1994 (No. FB-04) 
This brief proposes that education funding be tied 
more closely to systemic reform initiatives. It 
describes past trends in school finance and current 
challenges to traditional education funding sources. 
Policy implications of these changes are presented, 
followed by a discussion of possible components of 
a finance system based on systemic reform. 



Politics and Systemic Education Reform, April 1994 
(Mo. RB-12) ' 

Many obstacles to systemic reform exist, but some 
promising efforts indicate that policymakers can en- 
act ambitious goals, supporting them with coherent, 
coordinated policies. This brief describes political 
challenges to systemic reform and explores condi- 
tions under which such policymaking might occur. 



Teachers' Professional Development and Education 
Reform, October 1993, (No. RB-11) 
This brief addresses the problem of "fit" between 
current education, reforms and prevailing approaches 
to professional development. It first summarizes the 
major themes of reform; it then focuses on the 
policy dilemma these reforms present for 
professional development. The brief also describes 
emerging alternatives to traditional professional 
development; and suggests principles to guide the 
design of professional development opportunities. 



Developing Content Standards: Creating a Process 
for Change, October 1993 (No. RB-!0) 
This brief outlines some lessons suggested by past 
and current efforts to develop ambitious standards. 
It draws on studies by CPRE researchers of stan- 
dards-setting processes in five states (VT, KY, NY, 
CA, and SC) and three national curriculum standards 
projects — NCTM's efforts to develop standards for 
math, the College Board's design of its Advanced 
Placement program, and the National Science 
Foundation's efforts of the 1950s and 1960s to 
reform science curricula. 



School Finance Refonn: The Role of the Courts, 
February 1993 (No. FB-03) 

This brief evaluates the status of seven fundamental 
problems of school finance litigation and reform, 
presents a three-part remedy, justifies the remedy as 
good policy, and concludes with a look ahead to the 
emerging concept of "program equity," 



School-Based Management: Strategies for Success, 
January 1993 (No. FB-02) 

This brief offers a new definition of school-based 
management and describes strategies for decentralizing 
management to improve the design of SBM plans. The 
design strategies focus on four components of control: 
power, knowledge, information and rewards. The brief 
draws from a national study of SBM being conducted 
by the Finance Center of CPRE. 
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Recent CPRE Research Reports 



Measuring Classroom Practice: Lessons Learned from 
Efforts to Describe the Enacted Curriculum 
John L. Smithson and Andrew C. Porter. 
September 1994, 25 pp. (No. RR-031) $10 

This paper addresses issues surrounding attempts to 
describe instructional practices and learning oppor- 
tunities. It draws from a study conducted by CPRE for 
the National Science Foundation-The Reform Up 
Close Study. The study examined the effects of state 
and district attempts to increase high school graduation 
requirements and other standard-setting activities in 
math and science. The paper focuses o-. the 
instrumentation used, the usefulness of the resulting 
classroom descriptions, and the quality of such data as 
determined by corroborative evidence 

On the Design and Purposes of State Curriculum 
Guides: A Comparison of Mathematics and Social 
Studies Guides from Four States 
Doug Archbald 

April 1994, 27 pp. (No. RR-029) $10 

The analysis focuses on the guides' rationales and 
prcscriptiveness in Texas, California, New York, and 
Florida. The concluding section discusses implications 
of differential prescriptiveness for local curriculum 
decision-making and practice. 



Merit Aid: Students, Institutions, and Society 
Michael S. McPherson and Morton Owen Schapiro 
August 1994, 25 pp. (No RR-030) $10 

Evidence suggests that the share of all institution-based 
student aid funds going to merit aid has been rising 
sharply over the last decade. This paper draws on 
recent data sets that have not previously been used in 
this context to pursue answers to several questions: 
What kind of institutions invest in merit aid? What 
kind of students are likely to receive merit aid? How 
has the level and distribution of merit aid been 
changing over time? What are the consequences of 
merit aid practice for the quality and distribution of 
educational opportunity in the United States? 



ERLC 



Ten Years of State Education Reform, 1983-1993: 
Overview with Four Case Studies 
Diane Massell and Susan Fuhrman with Michael Kirst, 
Allan Odden, Priscilla Wohlstetter, Rebecca Carver, 
and Gary Yee 

January 1994, 171 pp. (No. RR-028) $15 

This report examines the state of education reform and 
policymaking over the 10 years following the pub- 
lication of the landmark report, A Nation at Risk in 
1983. It compares and contrasts 1983 and 1993 across 
a variety of aspects: the players involved, the capacity 
of the system to undertake reform; and the major 
instruments of reform. The analysis is published 
together with case histories of reform in California, 
Florida, Georgia and Minnesota, but it also draws upon 
the education efforts of other states. 



Issues and Strategies in Sys: mic Reform 
Susan H. Fuhrman and Diane Massell 
November 1992 (No. RR-025) 30 pp., $10 

Since the \- t 1980s, support has been growing for a 
"systemic" vision of reform which would pair ambi- 
tious, coordinated state policies with professional dis- 
cretion at the school site. Drawing from research on 
state reform efforts conducted over several years by the 
Consortium for Policy Research in Education, the 
report addresses questions regarding the vision driving 
systemic reform; how political support of such reform 
is maintained; and the equity implications of systemic 
reform strategies. 
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performance of American students by providing useful 
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• To focus research on policies that foster high levels 
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• To conduct research that will lead to more coherence 
of state and local policies that promote student 
learning. 

• To study how policies respond to diversity in the 
needs of students, schools, postsecondary institu- 
tions, and states; and to learn more about the 
connections between student outcomes and resource 
patterns in schools and postsecondary academic 
departments. 
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